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[57] ABSTRACT 

A sensing array for color imaging includes individual 
luminance- and chrominance-sensitive elements that 
are so intermixed that each type of element (i.e,, ac^ 
cording to sensitivity characteristics) occurs in a re- 
peated pattern with luminance elements dominating 
the array. Preferably, luminance elements occur at 
every other element position to provide a relatively 
high frequency sampling pattern which is uniform in 
two perpendicular directions (e.g., horizontal and ver- 
tical). The chrominance patterns are interlaid there- 
with and fill the remaining element positions to pro- 
vide relatively lower frequencies of sampling. 

In a presently preferred implementation, a mosaic of 
selectively transmissive filters is superposed in 
registration with a solid state imaging array having a 
broad range of light sensitivity, the distribution of 
filter types in the mosaic being in accordance with the 
above-described patterns. 



11 Claims, 10 Drawing Figures 
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ments, respectively). However, in U.S. Pat. No. 
COLOR IMAGING ARRAY 2,755,334, also to Banning, a repeated arrangement of 

four element groupings (redr, green-, blue-, and white- 
BACKGROUND OF THE INVENTION sensitive elements, respectively) is described. Such 

1 . Field of the Invention 5 approaches to color imaging have not been of practical 
The invention relates to imaging devices and, in par- significance, in part because of the cost of fabricating 

ticular, to color image sensors, the number of individual elements which are required 

2. Description Relative to the Prior Art to provide image information, having adequate detail. 
Color image sensors of various types have been pro- In summary; while color imaging devices having a 

posed for and used in video cameras. To avoid optical 10 single imaging site are desirable to minimize optica! 
complexity and problems with image registration; it is and registration problems and to. provide a more rug- 
highly desirable that color image sensing occur at a ged camera structure, video camera manufacturers 
single imaging site, e.g., at a single planar photosensi- generally resort to splitting the image beam and provid- 
tive array. Difficulty is encountered. with such "single- ing multiple image scanners in order to achieve a satis- 
site" color imaging, however, because at least three *5 factory type and quality of color video signal, 
distinct types of color information must be extracted in SUMMARY OF THE INVENTION 

order to represent a color image in video signal form. 

One known approach to providing a single-site color Color imaging is effected by a single imaging anay 
sensing device utilizes a single image sensor of broad composed of individual luminance and chrominance 
wavelength sensitivity and a cooperating filter disc 20 sensing elements that are distributed according to type 
which passes a series of color filters through the image (sensitivity) in repeating interlaid patterns, the lumi- 
beam in a repeating sequence. The filter interpositions nance pattern exhibiting the highest frequency of oc- 
are synchronized to image scanning, a filter typically currence — and therefore the highest frequency of 
being interposed during an entire field scan. Devices image sampling — irrespective of direction on the ar- 
operating in this manner are said to produce a "field 25 ray. 

sequential" color signal. One problem with this ap- In providing for a dominance of luminance sampling, 
proach is that the resulting signal presents the extracted recognition is taken of the human visual system's rela- 
color image information in a time order which is radi- tively greater ability to discern luminance detail. By 
cally different from the time order of the standard arranging the luminance elements of the color image 
NTSC video signal. A further disadvantage is that some 30 sensing array to occur at every other array position, a 
of the color image information (e.g., blue image infor- dominance of luminance elements is achieved in a . 
mation if a blue basic color vector is utilized) tends to pattern which has the special advantage of uniformity 
be disproportionately detailed and hence wasteful of in two orthogonal directions (e.g., horizontal and verti- 
sensor capacity in consideration of the response char- cal). Moreover, by so intermixing three types of ele- 
acteristics of the human visual system, 35 ments (luminance, and first and second chrominance) 

Certain other proposed approaches to achieving sin- that luminance elements occur at every other array 
gle-site color image sensing call for the use of striped position, and first and second chrominance demerits 
color filters superposed on a single image sensor. One alternate with such luminance elements in respective, 
such type of image sensor utilizes filter grids which are alternate rows of the array, there is provided a lumi- 
angularly superimposed on one another (see U.S. Pat 40 nance-dominated sampling which is uniform for all 
No. 3,378,633). As a result of image scanning, such three color vectors in two orthogonal directions. Cer- 
image -sensors produce a composite signal wherein tain desirable sampling attributes which result from the 
chrominance information is represented in the form of special uniformities of such arrangements are discussed 
modulated carrier signals. Such apparatus may be in the detailed description below, 
adapted to produce signals in the NTSC format or, if 45 Preferably, to produce an element array according to 
desired, the color image information can be separated the invention, a solid state sensor array of broad wave- 
by frequency domain techniques. In practice, however, length sensitivity is provided with a superposed filter 
it has proven difficult to produce such sensors econom- mosaic. Filters of the mosaic are arranged in one-to- 
ically, particularly where detailed image information is one registration with elements of the sensor array and 
required. 50 have light passing characteristics in accordance with 

Striped filters which transmit a repeating sequence of the above-described interlaid pattens. Filters which are 
three or more spectral bands have also been proposed selectively transparent in the green region of the spec- 
for use in color imaging. With this arrangement, the trum are preferably employed in producing luminance- 
filters are typically aligned vertically and scanning of type elements, and filters which are selectively trans- 
the image is performed horizontally. In effect, elemen- 55 parent in the red and blue spectral regions, respec- 
tal sample areas are defined along the filter stripes. tively, are preferably employed in producing chromi- 
With this arrangement, it will be appreciated, sampling nance-type elements. (The term "luminance" is herein 
for a given color is not uniform for horizontal and verti- used in a broad sense to refer to the color vector which 
cal directions. Additionally, the sampling patterns is the major contributor of luminance information. The 
which result tend to provide a disproportionate quan- 60 term "chrominance" refers to those color vectors other 
tity of information regarding basic color vectors to than the luminance color vectors which provide a basis 
which the eye has less resolving power, e.g., "blue" for defining an image.) 

information relative to "green" information. In an important alternative for implementation of the 

Another approach to color imaging which has been invention, three interlaid patterns, (a green-, a red-, 
proposed is the "dot" scanning system, as discussed in 65 and a blue-sensitive element pattern) are so arranged 
U.S. Pat.. No. 2,683,769 to Banning. That approach that green-sensitive elements (serving to detect lumi- 
generaily utilizes spectrally selective sensor elements nance), occur at every other array position, with red- 
which are arranged. in triads (red, green, and blue ele- sensitive elements alternating with such green-sensitive 
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elements in alternate rows — as in the case for the and uniform in two orthogonal directions (e.g., hori- 

presently preferred implementation. En the remaining zontal and vertical), as is readily seen from FIG. IB. 

element positions, however, blue-sensitive elements, FIGS. 2 A, 2B, and 2C illustrate the advance over 

alternate with red-sensitive elements to produce a lumi- certain prior art by means of the invention. Referring to 

nance-dominated image sampling having a dispropor- 5 FIGS. 2A, 2B, and 2C, the distance between rows of 

tion. in the chrominance samples favoring red over elements in the horizontal and vertical directions is 

blue. With this arrangement, sampling rates for all shown for the luminance pattern 2 (FIG. 1A), and for 

three basic color vectors are adjusted respective of the prior art striped element patterns (e.g., as would exist 

acuity of the human visual system. That is, blue detail, where a vertically striped filter is superposed on a sen- 

to which the human visual has least resolution, is sam- 10 sor array). Luminance pattern 2 (FIG. 2A) is seen to 

pled the least frequently . . . green detail, to which the provide uniform sampling in the horizontal and vertical 

human visual system is most responsive, is sampled directions, whereas the striped patterns of FIGS. 2B 

most frequently. and 2C do not. (Note: FIG. 2B shows a striped arrange- 

It will be appreciated from the foregoing that with ment having a numerically similar luminance element 

selectively sensitized elements cooperating in interlaid 15 population, and FIG. 2C shows a striped filter of the 

sampling patterns according to the invention, image tv Pe having alternating stripes for each of three basic 

information is extracted with an efficient use of sensing c °l° r vectors.) For each row and column of elements, 

elements because relative Image sampling rates, by the FIG. 2 A luminance elements (and hence luminance 

color, are in effect adjusted respective of the character- samples) occur at regular intervals. Moreover, by 

istics of human visual response. Moreover, with the 20 means of the invention, not only the luminance pattern, 

uniformities of such interlaid sampling patterns, desir- but ^ other patterns (4 and 6, FIG. 1A) of a sensor 

able sampling attributes are achieved for a plurality of according to the invention become regular and uniform 

sensing element types (color sensitivities) cooperating in two orthogonal directions. 

in a color imaging device. Tne preferred luminance pattern as especially desir^ 

The invention is described with reference to the 25 ? ble sam P 1 j n S qualities which result from the uniform- 
drawings, wherein: j tv m ^ orientation thereof. Of the possible patterns 

FIG. 1A is an exploded pictorial representation including only half of the element positions of a sub- 
showing preferred sensing element patterns for practic- stantially rectangular array, the preferred pattern is the 
ing the invention; n one ^ affords the largest useful region of frequency 

FIG. IB is a pictorial representaion corresponding to sp . a< : e ' i e . considering all directions on the array, the 

FIG. 1A; minimum Nyquist limit is largest Moreover, because of 

FIGS. 2 A, 2B, 2C, and 2D are patten representations ^ orientation of the preferred pattern to the major 

teaching a sampling characteristic of preferred forms of tIus 1 usa ° le «g»n proves more extensive in the. 

the invention* horizontal and vertical directions . . . those directions 

FIG. 3A is a cross-sectional representation, in part, of " whe f c . ^ human ™ ub1 s y stem is said to have 
a row of sensing elements in accordance with a pre- resolving power. 

ferred implementation- of the invention; . To ^ er I 3S ) ^ T l the ' e quakes, reference 

RG. 3B is a cross-sectional representation, in part, of * m *f e * HG : ™: wher / ^P 1 ^ frequencies 
a row of sensing elements adjacent the row represented 40 SnfiXS? ^ P£ ferred ^minance patten are 
in FIG 3A' graphically illustrated in frequency space. By virtue of 

FIG. 4 is a perspective representation showing a basic £tffi^^ ^ pH ? 8 pat " 

arrangement of elements for a camera system accord- 2£l % e nSZ^Sh ? ? ™ * * T 

inc to the invention- equal. The Nyquist or usable frequency region, i.e., the 

ran c ;„ n a: ' n • region including frequencies closer to the origin than to 

JSt *^T^^* r , epresent ? t,on « eneraU y ,n 45 the sampling frequencies, is located in a ntanLy 
block form illustrating signal processing anangements * on ? OB ^ fre ' (fadfcaS by a 

Z tavent^Tnd W SenS ' ng arfayS aCCOTdln8 10 dashed ?ine > havin 8 its ^na* *»igned **** h°ri 

m S no nou , tn „ r(l i a ariA in tk • i. 30 Referrin 8 now to TOS. 3A and 3B, a preferred imag- 
ed J ^' V"? 1B ^ CrC ' S Sh0Wn , 3 ta « apparatus for implementing the invention employs 
set.of three sensor patterns 2, 4, and 6, respectively, a soUd state imaging' array 20 of the CCD type com- 
which are interlaid to form an .mage sampling array 8, pris ed of individual sensor elements (e.g., e eTent 22 
each such pattern eonespondmg to a. different basic extending between the dashed lines of FIG. 3A) A 
color vector. The pattern 2 (hereinafter referred to as 55 fii ter m0 saic 24 is superposed on imaging array 20, 
the luminance pattern) has the highest element popula- which mosaic includes individual filters (el, filter 26) 
ion, and is made up of luminance-sensitive elements in one-to-one registration with individual sensor ele- 
(denoted Y), whtch are arranged at every other ele- ments of the array (e.g., the element 22). Individual 
ment position. With this pattern, it will be appreciated, filters of mosaic 24, forming a filter mosaic over the 
luminance elements (and hence luminance samples) «0 array 20, are of the selectively transmitting type, and 
occur at half of the element positions of the array and are arranged in patterns as described above Theletters 
are uniformly distributed over the entire.array. First G, R, B on individual filters of mosaic 24 (FIGS 3A 
and second chrominance patterns 4 and 6 alternate and 3B) serve to indicate green, red. and blue light 
with the luminance pattern in alternate rows, respec- transmission characteristics, respectively, as would be 
tively, to provide a composite sampling array, devoid of «5 employed according to the presently preferred form of 
overlapping. As a result of this arrangement, sampling the invention. Filters selectively transmissive to light in 
of an image, for all three basic color vectors (i.e., lumi- the green region of the spectrum are utilized in produc- 
nance, first and second chrominance), is symmetrical ing luminance-sensitive elements, and red and blue 
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transmitting Alters are used, for prpdMcing ,first v and^ elements. Through this .arrangernent, image sampling is 

second chrominance-sensitive elements. j. / . t : , coordinated to -closely rnatcjwthe., response of : the . 

A. selectively sensitive, color, imaging element, such human visual system; however, ft will be appreciated, 
as elerrient 26, t is formed py, each one of filters .24 in that separating and storing red and blue image infprma- , 
combination with a.conesppnding array , sen^r 5 uon becomes rnpre complicated when the red and blue 
element 26 the sensor denoted 22^ patterns differ; v: . < . . . : > : .■ 
ate^ f \i6w6\eT,Hhai an array according to Ae invention invention, has been (described in detail with par- 
might also" be formed bf senses havirig : selective wSve- ticular ; respect jto ; implementations thereof, but it will 
length sensitivity; or by 'use of lenticular Tdtere separate be appreciated that variations and modifications can be 
from "ah array of Sensor elements, which filters selec-' 10 effected, within the spirit and scope pt the invention, 
tively limit the wavelengths of light arnvirig at individ-- f For example; a^variety. of sensors might be employed,, 
ual elements of such array. " • ; including: the.sensbrs of CCD or GID imaging arrays. 

Referring to FIG;4, a color imaging* array 30accord- Moreover, color-sensitive elements for . use in the in- 
ing to the inventipn. is shown in' a simplified camera*, vention may have inherent selective sensitivity, or may 
environment; (mage information from' individual; rpwfr; * 5 incorporate filters either adjacent to or removea" from a 
of the ; array, such as aT0W;32, is transfefred tq a shift broad-wavejength-range sensor, which filters, selec- . 
register 34 (generally formed "on board" the imaging:; tively limit the range of sensitivity, for individual sen- 
chip) in response to signals from an interrogating appa- sprs. Also, while the invention is.xast in the envirpn- 
ratus such as a line scan clock 36. Such operation is ment of a camera utilization, it has other uses, for ex- 
well known, and apparatus for performing same is de- 20 ample, in connection. with a display device, 
scribed in literature and patents regarding CCD arrays. What is claimed is: 

It is also generally known to process the output signal 1. A color imaging device comprising an array of 
of the register by means of a circuit 38. Using color light-sensitive elements, which array includes at least 
imaging arrays according to the invention, however, (I) a first type of element sensitive to a spectral region 
information for the various base color, vectors is inter- 25 corresponding to luminance, (2) a second type of ele- 
spersed as a result of the intermixed sensitivities of the ment sensitive to one spectral region corresponding to 
color array elements. Accordingly, a switching network chrominance, and (3) a third type of element sensitive 
40 is provided to separate the image signal sequence to to a different spectral region corresponding to chromi- 
a usable form, for example, to parallel green, red,, and nance, the three types of elements occurring in repeat- 
blue video signals. 30 ing patterns which are such that over at least a major 
In such form, the signals are conveniently converted portion of said array luminance-type elements occur at 
to NTSC format using a conversion matrix of 2. This is every other element position along both of two orthog- 
especially convenient if the number of rows in the array onal directions of said array. 

corresponds to the number of visible lines in a field 2. A device in accordance with claim 1 wherein said 

scan (approximately 250) or the number of visible lines 35 luminance-type elements: are sensitive in the green 

in a frame (approximately 500) comprised of inter- region of the spectrum, and the two types of chromi- 

laced fields. nance elements are sensitive in the red and blue regions 

A simplified diagram for a switching network 30 is of the spectrum, respectively, 

shown in FIG. 5. Sample and hold units 50 and 52 are 3. An array in accordance with claim 1 wherein the 

employed in alternating operation to separate out, re- 40. t elements are arranged in a substantially rectangular 

spectively, green information and the chrominance pattern and the two chrominance types of sensors alter- 

information. The latter alternates between red and blue nate with the luminance sensors in alternate rows, re- 

with each successive row of the array. Since red infor- spectively, of the rectangular pattern, 

mation and blue information is received on an alternat- 4. A color image sensor comprising: 

ing row basis, such information is stored in a register 54 45 \ a. a substantially planar array of solid state light-sen- 

for an entire row and shifted out serially as the next sitive elements; and 

row's luminanee information arrives. b. a filter mosaic made up of individual filter ele- 
To maintain the same output channels for red infor- ments which are superposed in one-to-one registry 
mation and blue information, irrespective of row, on said light-sensitive elements, said mosaic being 
switching means 56 alternates the output connection 50 comprised of a first type of filter element having a 
from the register with each row of output information. luminance transparency characteristic, a second 
An important alternative set of patterns for imple- type of filter element having a transparency char- 
menting color imaging arrays according to the inven- acteristic different from that of said first type* and 
tion is shown in FIG. 6. The luminance (green) pattern, a third type of filter element having a transparency 
having elements denoted by a "G", assumes every 55 characteristic different from that of said first and 
other array position. A red pattern, having elements second types* such filter elements being arranged 
denoted by an M R", alternates with luminance elements in repeating patterns respective of type with the 
(denoted "B") in alternate rows, and red elements also luminance filters occurring at every other array 
alternate with blue elements in filling the remaining position in two perpendicular directions through- 
element positions. By this arrangement, blue elements 60 > out substantially the entire imaging area of the 
contribute only one-eighth of the element population . sensor. 

. . a recognition of the human visual system's relatively 5. A sensor according to claim 4 wherein the first 

limited ability to discern blue detail. Red detail, to type filters are arranged at every other array position, 

.which the human visual system is more responsive, is and said second and third type filters alternate with the 

sampled at a higher rate than for blue detail by virtue of 65 : first type filters in respective alternate rows of the ar- 

the relatively greater population of red-sensitive ele- ray. 

ments. Luminance detail, to which the human eye is 6. A sensor according to claim 4 wherein the fust 

most responsive, is sampled by the largest population of type filters occur at every other array position, and the 
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third type filters occur in alternate rows at every fourth 
position, the second type filters occurring at all remain- 
ing positions, whereby a hierarchy of distributed sam- 
pling populations is provided. 

7. A sensor according to claim 6 wherein the first 
type of filter transmits for the green spectral range, the 
second type of filter transmits for the red spectral 
range, and the third type of filter transmits for the blue 
spectral range. 



8 



elements, one second-type element, and one third- type 
element 

9. A video image sensor according to claim 8 wherein 
said first-type elements within the individual groups are 
aligned in a common diagonal direction. 

10. A video image sensor according to claim 9 
wherein said first-type element is sensitive to the green 
region of the spectrum, the second-type element is 



8. A video image sensor comprising a first type of 10 sensitive to the red region of the spectrum, and the 

element sensitive to a luminance region of the spec- third-type element is sensitive to the.blue region of the 

trum, and a second and a third type of element sensitive spectrum. 

to respective different chrominance regions of the' An ima S e sensor according to claim 8 wherein 

spectrum, said sensor, over substantially the entire individual first-, second-, and third-type elements are 

imaging area thereof, having such elements arranged as 1 5 comprised of a broad spectrum photoresponsive device 

a mosaic of individual groups of four neighboring ele- with a spectrally selective filter superposed in registry 

ments in a generally square configuration, which therewith, 
groups each include two diagonally-arranged first-type * * * * * 
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